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(57) A method for recommending items to users us- 
ing automated collaborative filtering stores profiles of 
users relating ratings to items in memory. Profiles of 
items are also stored in memory, the item profiles asso- 
ciating users with the rating given to the item by that 
user. Similarity factors with respect to other users are 
calculated for a user, and these similarity factors are 
used to select a set of neighboring users. The neighbor- 
ing users are weighted based on their respective simi- 
larity factors, and a rating for an item contained in the 
domain is predicted. In one embodiment, items in the 
domain have features. In this embodiment, the values 
for features can be clustered, and the similarity factors 
incorporate assigned feature weights and feature value 
cluster weights. 
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Description 

The present invention relates to a method and apparatus for recommending items and. m particular, to a method 
and apparatus for recommending items using automated collaborative filtering and feature-guided automated coilab- 
5 orative filtering. 

The amount of information, as well as the number of goods and services, available to individuals ts increasing 
exponentially. This increase m items and information is occurring across all domains, e.g. sound recordings, restau- 
rants, movies. World Wide Web pages, clothing stores, etc. An individual attempting to find useful information, or forced 
to decide between competing goods and services, is often faced with a bewildering selection of sources and choices. 
10 Individual sampling of all items, even in a particular domain, may be impossible. For example, sampling every 

restaurant of a particular type in New York City would tax even the most avid diner. Such a sampling would most likely 
be prohibitively expensive to carry out. and the diner would have to surfer through many unenjoyable restaurants. 

In many domains, individuals have simply learned to manage information overload by relying on a form of generic 
referral system For example, in the domain of movie and sound recordings, many individuals rely on reviews written 

15 by paid reviewers. These reviews, however, are simply the viewpoint of one. or perhaps two. individuals and may not 
have a likelihood of correlating with how the individual will actually perceive the movie or sound recording. Many indi- 
viduals may rely on a review only to be disappointed when they actually sample the item. 

One method of attempting to provide an efficient filtering mechanism is to use content-based filtering. The content- 
based filter selects'items from a domain for the user to sample based upon correlations between the content of the 

20 item and the user's preferences. Content-based filtering schemes suffer from the drawback that the items to be selected 
must be of some machine-readable form, or attributes describing the content of the item must be entered by hand. 
This makes content based filtering problematic for existing items such as sound recordings, photographs, art. video, 
and any other physical item that is not inherently machine-readable. While item attributes can be assigned by hand in 
order to allow a content-based search, for many domains of items such assignment is not practical. For example, it 

25 could take decades to enter even the most rudimentary attributes for all available network television video clips by hand. 

Perhaps more importantly, even the best content-based filtering schemes cannot provide an analysis of the quality 
of a particular item as it would be perceived by a particular user, since quality is inherently subjective. So, while a 
content-based filtering scheme may select a number of items based on the content of those items, a content-based 
filtering scheme generally cannot further refine the list of selected items to recommend items that the individual will 

30 enjoy. 

The present invention, in one aspect, relates to a method for recommending an item to a user which the user has 
not yet rated. A profile for each user is stored in a memory, and each user profile includes ratings given to items by 
the user. A profile for each item is stored in a memory, and each item profile includes ratings given to the item by the 
users. 

35 a set of similarity factors are calculated for each user; each similarity factor represents the degree of agreement 

between two users' opinions for all items. Using these similarity factors, a set of neighboring users is selected for each 
user. The neighboring users are assigned a weight. Using the weights and the ratings given to items by the neighboring 
users, a recommendation for an item not yet rated by a user is made. 

In some embodiments, the calculating step comprises receiving a rating from one of the users for one of the items. 

-to Both the rating user's profile and the rated item's profile are updated with the received rating, and a new set of similarity 
factors are calculated for the rating user. In other embodiments, ratings for items are received via a local area network 
or a wide area network. 

In one embodiment, once a rating for an item is received from a user, the rated item's profile is retrieved to determine 
other users that have also rated the item. A new plurality of similarity factors is calculated for the rating user only with 
45 respect to the users that have also rated the item. 

In certain embodiments, the similarity factors for a particular user are calculated by retrieving an item profile, 
determining other users that have also rated the item, and calculating a similarity factor between the particular user 
and each of the other users that have also rated the item. These steps are repeated until all items rated by the particular 
user have been retrieved and all similarity factors for the user have been calculated. These steps, in turn, are repeated 
so until similarity factors for all users have been calculated. 

In one embodiment, the similarity factors are calculated by subtracting the rating given to the item by each of the 
other users from the rating given to the item by the requesting user, squaring each rating difference, and dividing the 
sum of the squared differences by the number of other users that have also rated the item. 

In another embodiment, the similarity factors may be a Pearson r correlation coefficient between users. In this 
55 embodiment, the similarity factor between user x and user y is then given by dividing the sum of the products of the 
mean score given to items by user x subtracted from the rating given to each item by user x and the mean score given 
to items by user y subtracted from the rating given to each item by user y by the square root of the product of two 
sums. The first sum is the squared differences between the rating given by user x to each item and the mean score 
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given to all items by user x. The second sum is the squared differences between the rating given by user y to each 
item and the mean score given by user y to all items. 

In other embodiments, users are selected as neighboring users when the similarity factor between two users is 
less than a predetermined threshold value. In still other embodiments, a weight is assigned to neighboring users by 
5 subtracting, for each neighboring user, the similarity factor for that neighboring user from the predetermined threshold 
value and dividing each difference by the predetermined threshold value. 

In some other embodiments, an item is recommended by predicting a rating for each item not yet rated by a user 
The predicted rating is arrived at by taking a weighted average of the ratings given to the items by the user's neighboring 
users. Items are then recommended to the user based on the predicted ratings. 
'0 in one embodiment, the user selects an item and a rating is predicted by taking a weighted average of the ratings 

given to the selected item by the user's neighboring users. 

In certain embodiments, information about the recommended items can be provided on a display. 

In another aspect, the present invention relates to a method for recommending an item to a user which has not 
yet been rated by the user, each item belonging to at least one group of items. A set of similarity factors for each user 
>s is calculated, representing the degree of agreement in item ratings between users within different groups. Neighboring 
users are selected within each group, a weight is assigned to each of the neighboring users for each group, and items 
are recommended based on fhe weights assigned to the user's neighboring users and the ratings given to the unrated 
item by the user's neighboring 1 users. 

In some embodiments, the simriarity factors are calculated by retrieving the item profile for afn item that has been 
20 rated by a user, determining other users that have also rated the item, calculating a similarity factor between the user 
and the other users that have also rated the item, and repeating these steps until ail items rated by the user m a group 
have been retrieved. These steps, in turn, are repeated until similarity factors for each user have been calculated. 

In one embodiment, the similarity factors are calculated only using ratings for other items belonging to the same 
group. 

25 in other embodiments, each selected neighboring user has a similarity factor less than a predetermined threshold 

value and neighboring users are assigned weights by subtracting, for each neighboring user, the similarity factor for 
that neighboring user from a predetermined threshold value and dividing each difference by the predetermined thresh- 
old value. 

In still other embodiments, a rating is predicted for an item in a group not yet rated by a user by taking a weighted 
30 average of the ratings given to the items in the group by the user's neighboring users, and recommending a predeter- 
mined number of items from the group based on the predicted ratings for those items. 

An item may be selected by the user, in which case a rating is predicted for the selected item by taking a weighted 
average of the ratings given to the selected item by the user's neighboring users within the group. The user may also 
select a particular group for which to receive recommendations, in which case, a rating is predicted for items in the 
35 selected group by taking a weighted average of the ratings given to the items in the group by the user's neighboring 
users for that group. A predetermined number of items are recommended based on their predicted rating. 

In certain embodiments, items belong to more than one group. In other certain embodiments, information about 
recommended items is provided on a display. 

In another aspect, the present invention relates to a method for recommending other users to a user User profiles 
+o are stored in a memory for each user, and each user profile includes ratings given to items by the user. Item profiles 
are also stored in a memory for each of the items, and each of the items belongs to one of a plurality of groups. Each 
item profile includes a plurality of ratings given to the item by one of the users. 

Similarity factors are calculated for each user, each similarity factor representing the rating similarity between each 
user and another one of the users for a particular group. Neighboring users are recommended to a user based on the 
i5 similarity factors. 

In a certain embodiment, a neighboring user is recommended based on the similarity factors and the number of 
items rated by both users. 

In another aspect, the present invention relates to a method for recommending an item, the item having at least 

one feature defining a characteristic of the item and having more than one possible value. The possible values may 
50 be grouped into clusters of feature values. User profiles are stored in a memory for each user, and the user profiles 

include ratings given to items by each user. Item profiles are also stored in a memory for each of the items, and the 

item profiles include ratings given to each item by the users. 

A weight is assigned to each cluster of feature values for each user. A weight is also assigned to each feature for 

each user. Using the feature weights, the feature value cluster weights, and the ratings given to itt oy the users, a 
55 set of similarity factors is calculated for each user. For each user, a set of neighboring users is selected responsive to 

the similarity factors; a weight is assigned to each of the neighboring users, and items are recommended to a user 

based on the weights assigned to the user's neighboring users and the ratings given to the unrated item by the user's 

neighboring users. 
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rtJlTf emb0d '7 k entS 3 we, 9 ht ,s ass '9 ned - each user, to each value cluster based on (he raung g.ven to the 
item by the user and the number of feature value clusters present 

of J^T^TfrT- 3 W6 ' 9hl ,S aSSiQned fpf 6aCh US6r t0 each f eatUfe - Thls ™ ^ done based on the number 
of feature defined for the .tern, or a feature we.ght may be ass.gned by based on the we.ghts ass.gned to each fe^ re 

In another aspect, the present invention relates to a method for recommending an .tern to a user the item ha/mo 
nit« ^ ? I T Pr0f " eS ar9 St0r6d ' n 3 mem0f V for each us*< a "d 'he user profile inc udes ratinas 

s: r e xr u e ; e r prof,les are s,ored in a memory for - « - - ^ ss 

A weight is assigned to each feature value cluster for each user. A weigh, is ass.gned to each feature for each 
user. Using he feature weights and the feature value cluster weights. simHarlty factors betweenttem * c^c2e6 

o ZT:I ZZrn^Trll 3 ' aVOrable ra,in ° feCeiVed '™ ,hS US " • and a n C um S 

or items are recommended to the users responsive to the item similarity lactots 

In another aspect, the present invention relates to an article of manufacture having program means for recom- 
,n a mS T ^ ^ M Program means Ls.cnng a use, proZ 

ZnTT Pr ° f " 9 ra,in9S 9IV6n 10 ,he " emS b * the US9r The aho incudes compter readab e 

program means for storing an „em profile ,n a memory; the „em profile mcludes ratings given to the iter! b he users 

simifaS So COmpu,er - readab,e P'°9 fam ™™ <°< calculating similarity factors for e ch user elch 0 * * e 
similarity factors representing the similarity between each user and another one of the users and compute^adable 
program means for selecting neighboring users for each user responsive to the similarly factors 

userl ^we^ ^ '° f aSS ' 9n ' n9 3 W9i9ht t0 9ac " <* *• n-ghboring 

users, as well as computer-readable program means for recommending an item to one of the users based on tha 
weights assigned to the use.s neighboring users and the ratings given to the unrated i^W Z^^I 

fl r a mH a rr er ' PrBSent inVen,i0n rela,8S t0 an articl9 of ™n««««ure including computer-readable pro- 
gram means for predict.ng a rating lor an item, the item having a. leas, one feature defining a charactensti oTthe Jem 
and having a plurahty of possible values that may be grouped into clusters of feature values 

Also included on the article are. computer-readable program means for storing a user profile in a memorv for each 

mIZb T^ZZV i 93Ch ' ,em Pr0fil8 inC ' Udin9 fa,ln9S 9iven to the i,9m fa V the ^ers: compu.er 

eaSb e o ooZ ZZ aSS ' 9n ' n9 ' ?' "** ^ 3 Wel9h, ,0 "** Va,Ue Clus,9r wi,hl " 9ac " compu.er- 
or ^. , , 9 , ,0rass, 9 n,n 9' ,or each a weight to each feature: computer-readable program means 

^22:^ S,milari, V ,ac,ors for 9a <* each similanty factor based on me feature weigh? he duster 

ZS^ZfZ^ " 6mS ^ reSPeC,iVe USerS: Program means lor selecting, for 

each user, a set of neighboring users responsive to the similarity factors; computer-readable program means for as- 

not a ! PeC, ^T e Pre8ent inVen,i0n re ' a,eS '° a " appara,us ,or amending an item to a user which has 

S tolmfnt h T ^ f PPara,US haS 3 mem0( V e| e-en« storing user profiles: each user profile includes atings 

g^lo^ 

reore^n^rJc 8 T™!"?** catoulaU ^ siM V ,ac,ors «" user, each of the similarity factors 

ZTrS^ T?* SaCh USSr an ° ,her ° ne °' ,he US9rs and mean8 tor selec,i "9, 'or each of the 

users, a set of neighboring users responsive to the similarity factors 

men^^f«! U r ,S ?^ S m6anS '°' 3 "'"S^ ,0 9ach °' ,he "^boring users: and means for recom- 

aTth7^ n„f n , L ,0 ^ °' ,h9 USerS taSed 0,1 ' he W6i9h,S ass,9ned t0 tha use ^ "«flW»«fl users 

and the ratings given to the unrated item by the user's neighboring users 

havin7 a T. a ^^^ r a a f ! P a T C, • ■? r eSen ' inV8mi0n re,at9S 10 a " appafa,US '° r ^^'"ending an item to a user, the ..em 
Z 2 J tk . 9 9 mn9 3 charac,eris,ic °' *° and having many poss.ble feature values that may be 

to mffJc 6 T I" Ud9S 3 m9m0,Y e ' ement ' 0r S,0rin 9 user pro,i,es: 9ach user P'°'«* "dudes ratings gnren 
11 1 T ? ! "I 9 ' m6m0ry 9l9n^,en, ' 9f S,0rin9 ,tem pf0,iles is also ,nclud9d: each Profile includes rat.ngs 
g.ven to the ,tem by the users. Means for assign.ng a weight to each value cluster within each feature is also provided 
The apparatus also includes: means for ass.gning. for each user, a weight to each feature: means for calculating 
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similarity factors for each user, each of the similarity factors based on the feature weights, the cluster weights, and the 
ratings given to items by the respective users: means for- selecting, for each of the users, a plurality of neighboring 
users responsive to the similarity factors: means for assigning a weight to each of the neighboring users: and means 
for recommending an item to one of the users based on the weights assigned to the user's neighboring users and the 
5 ratings given to the unrated item by the user's neighboring users. 

Certain embodiments of the invention will now be described by way of example and with reference to the accom- 
panying drawings, in which: 

FIG. 1 is a flowchart of one embodiment of the method of the present invention; 
10 FIG. 2 is a flowchart of one embodiment of the method of the present invention; 

FIG. 3 is a block diagram of an embodiment of the apparatus of the present invention; and 

FIG. 4 is a block diagram of the Internet system on which the preferred methods and apparatus may be used. 

As referred to in this description, items to be recommended can be items of any type that a user may sample, such 
'5 as sound recordings, movies, restaurants, vacation destinations, novels, or World Wide Web pages. When reference 
is made to a "domain.' it is intended to refer to any category or subcategory of ratable items, such as sound recordings, 
movies, or restaurants in a particular city. Referring now to FIG. V, a method forVecommending items begins by storing 
user and item information in profiles. 

A plurality of user profiles is stored in a memory element (step 102)^ It is preferred that one* profile is created for 
20 each user, however, multiple profiles may be created for a user to represent that user over multiple domains. The 
memory element can be any memory element known in the art that is capable of storing sufficient data for the plurality 
of profiles and allowing the profiles to be updated, such as disc drive or random access memory. 

Each user profile associates ratings given to an item by the user with a particular item. User profiles can be any 
data construct that facilitates this association, such as an array, although it is preferred to provide user profiles as 
25 sparse vectors of ordered pairs. Each ordered pair contains a number representing the rated item and a number rep- 
resenting the rating that the user gave to the item. 

In the preferred embodiment, a profile for a user is created when that user first begins rating items, although in 
multi-domain applications user profiles may be created for particular domains only when the user begins to explore, 
and rate items within, those domains. Whenever a user profile is created, a number of ratings for items are solicited 
^0 from the user. This can be done by providing the user with a particular set of items to rate corresponding to a particular 
group of items. Groups are genres of items and are discussed below in more detail. Other methods of soliciting ratings 
from the user include: manual entry of item-rating pairs, in which the user simply submits a list of items and ratings 
assigned to those items: soliciting ratings by date of entry into the system, i.e. , asking the user to rate the newest items 
added to the system: soliciting ratings of the most rated items: or by allowing a user to rate items similar to an initial 
35 item selected by the user. The preferred embodiment uses all of the methods described above and allows the user to 
select the particular method they wish to employ. 

Profiles are stored for each item that has been rated by at least one user (step 104). Each item profile records 
how particular users have rated this particular item. Any data construct that associates ratings with certain users can 
be used. It is preferred is to provide item profiles as a sparse vector of ordered pairs. Each ordered pair contains a 
-to number representing a particular user and a number representing the rating that user gave to the item. Item profiles 
are created when the first rating is given to an item. Although FIG. 1 shows item profiles being stored after user profiles, 
the two may be stored in any order, and can occur simultaneously 

A similarity factor for each user is calculated with respect to ail other users (step 106), and represents the degree 
of similarity between any two users with respect to all items, it is currently preferred that the more similar two users 
are, the closer the similarity factor is to zero. Specialized hardware may be provided for calculating the similarity factors 
between users, although it is preferred to provide a general-purpose computer with appropriate programming to cal- 
culate the similarity factors. 

The similarity factor may be calculated by comparing a user's profile with the profile of every other user. This is 
computationally intensive, however, and it is preferred to calculate the similarity factor by first examining the profiles 

so of each item for which a user has entered a rating and determining which other users have also rated each item. The 
similarity factors between the user and the other users that have also rated the items are the only similarity factors 
updated. These steps are repeated for all users. 

Ratings for items are received from users. Item ratings can be of any form that allows users to record subjective 
impressions of items based on their experience of the item. For example, items may be rated on an alphabetic scale 

ss ("A" to "F") or a numerical scale (1 to 10). It is currently preferred that ratings are integers between 1 (lowest) and 7 
(highest). Ratings can be received as input to a stand-alone machine, as input to a system via electronic mail, or as 
input to a system via a local area or wide area network. In the currently preferred embodiment, ratings are received 
as input to a World Wide Web page. Ratings can be received from users singularly or in batches, and may be received 
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from any number of users simultaneously. 

Whenever a rating ,s received from a user. ,he profile of the user who entered the rating must be updated as well 

? w a 2T ^ ' 18 Pr9ferred h0WeVSr '° Update pr0,i,es whenever a n ™ f a.,ng ,s entered by a user Ratings 
are updated by appending a new pa,r of values to the set of already existing ordered pa,rs .n the profile 

Whenever a user's profile is updated because a rating has been received from the user, new scanty factors 
between the user and all other users of th,s system must be calculated. Th,s can be done by comparing he a nas 

ZZl T, ^ USef *° ra " n9S 9 " en 10 " emS by 3,1 ° ,her USerS « • cui-Juy preSr e 9 d o elce 

the amount of computation necessary ,n the following manner. Whenever a user enters a rating for an ,.em that "em's 
pro he is retneved and the identity of other users that have also rated the „em is determined .n th way on vThe 
similarity factors between the rating user and other users that have also rated the item are updated 

^XhT^S. Z m,ze ,he avera " error between a predlc,ed ra,in9 for an " em and »• ^ a - 

for imm «',il C l eS,rabl9 ,0 redUC9 err ° f in CaSSS ' nVOlVin9 " eXtreme " ratin 9 s - That is ' a me,h <* which predicts fairly well 
In lln 9 r f P ' eSe H ntin9 ambiva ^« awards an item but which does poorly for item ratings representing extreme 
en,oyment or extreme disappointment with an item ,s no. useful for recommending items to users 

u ,»r J^n lty ,a T C h ,0r f s ,f e,ween users re,ers t0 a "V ^ a "'*«y which expresses the degree of correlation be.we.e- two 

» I hi - n ? 1 9 me,h0dS '° r CalCU ' atin9 the Similaf,t y ,ac,or are intended to " exemplary, and in n.- . ,y 

dl a 1 ,,?T en , T n ' he 1,em d ° ma,n ' d^,,er9^, me,hods wi " produce optimal resul <* •*£ in dmVen 

domains will tolerate different expected errors. 

v h '"Jn^ 0 ''?^ deSCript ' 0n 0f methods " °*y re P resenls tn * similarity factor calculated between two users, x and 

L^h Tc ? V 9 T 6 " t0 ' tem * by US6f *' ' re P resents afl **™ the database, andc jx is a Boolean quantity 
which is 1 if user x has rated item i and 0 if user x has not rated that item 

25 bprw««n °' C f CUlatinQ Sim,,anty b9tWeen 3 P3ir ° f USers 15 t0 calculate th * avera 9e squared d.fference 

TuZl< 7 T °' mUtUal,V rat6d ,t9mS ThUS * the Sim,,arity faCt0f between us * r * an « ier y is calculated by 
umractmg, for each ,tem rated by both users, the rating given to an item by user y from the rat.ng given to that same 

items rated. This method is represented mathematically by the following expression: 



to 
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A similar method of calculating the similarity factor between a pair of users ,s to divide the sum of their squared 
a ng differences by the number of items rated raised to a power greater than 1. This method is represented by the 
following mathematical expression: y 



so 



ss 



2 

so? 



K\' 



where IC^I represents the number of items rated by both users and k is greater than 1 

A third method for calculating the similarity factor between users attempts to factor into the calculation the amount 
of overlap between two user profiles. Thus, for each item rated by both users, the rating given to an item by user y is 
subtracted from the rating given to that same item by user x. These differences are squared and then summed The 
amount of profile overlap is taken into account by dividing the sum of squared rating differences by a quantity equal 
to the number of items mutually rated by the users subtracted from the sum of the number of items rated by user x and 
the number of items rated by users y. This method is expressed mathematically by: 
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where \C %y \ represents the number of items mutually rated by users x and y. 

In another embodiment, the similarity factor between two users is a Pearson r correlation coefficient. Alternatively, 
the similarity factor may be calculated by constraining the correlation coefficient with a predetermined average rating 
value. A. Using the constrained method, the correlation coefficient, which represents D^. is arrived at in the following 
manner. For each item rated by both users. A is subtracted from the rating given to the item by user x and the rating 
given to that same item by user y. Those differences are then multiplied. The summed product of rating differences is 
divided by the product of two sums. The first sum is the sum of the squared differences of the predefined average 
rating value. A. and the rating given to each item by user x. The second sum is the sum of the squared differences of 
the predefined average value, A, and the rating given to each item by user y. This method is expressed mathematically 
by: " 



where U x represents all items rated by x. U y represents all items rated by y, and represents all items rated by both 
x and y. 

Regardless of the method used to generate them, the similarity factors are used to select a plurality of users that 
have a high degree of correlation to a user (step 108). These users are called the user's "neighboring users." The 
neighboring users are selected from all other users based on having a similarity factor with respect to the requesting 
user less than a predetermined threshold value, L The threshold value, L, can be set to any value which improves the 
predictive capability of the method. In general, the value of L will change depending on the method used to calculate 
the. similarity factors, the item domain, and the size of the number of ratings that have been entered. 

A weight is assigned to each of the neighboring users (step 110). In the preferred embodiment, the weights are 
assigned by subtracting the similarity factor calculated for each neighboring user from the threshold value and dividing 
by the threshold value. This provides a user weight that is higher, i.e. closer to one, when the similarity factor between 
two users is smaller. Thus, similar users are weighted more heavily than other, less similar, users. 

Once weights are assigned to the neighboring users, an item is recommended to a user (step 112). For applications 
in which positive item recommendations are desired, items are recommended if the user's neighboring users have also 
rated the item highly. For an application desiring to warn users away from items, items are displayed as recommended 
against when the user's neighboring users have also given poor ratings to the item. Once again, although specialized 
hardware may be provided to select neighboring users and weight them, it is currently preferred to provide an appro- 
priately programmed general-purpose computer to provide these functions. 

The item to be recommended may be selected in any fashion, so long as the ratings of the neighboring users and 
their assigned weights are taken into account. In one embodiment, a rating is predicted for each item that has not yet 
been rated by the user. This predicted rating is arrived at by taking a weighted average of the ratings given to those 
items by the user's neighboring users. A predetermined number of items are then recommended to the user based on 
the predicted ratings. 

The predetermined number of items can be selected such that those items having the highest predicted rating are 
recommended to the user. Alternatively, the predetermined number of items may be selected based on having the 
lowest predicted rating of all the items. 

In another embodiment the user selects an item for which a predicted rating is desired. A rating is predicted by 
taking a weighted average of the ratings given to that item by the user's neighboring users. 

Whatever method is used, information about the recommended items can be displayed to the user. For example, 
in a music domain, the system may display'a list of recommending albums including the name of the recording artist, 
the name of the album, the record label which made the album, the producer of the album, "hit" songs on the album, 
and other information. In the embodiment in which the user selects an item and a rating is predicted for that item, the 
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The notion of. similarity between any two feature values is how similarly they have been rated by the same user, 
across the whole spectrum of users and items. One method of defining the similarity between any two feature values 
is to take a simple average. Thus, we define the vaJue to be the mean of the rating given to each item containing 
feature value FV^ that user i has rated. Expressed mathematically: 

Undefined otherwise 



Where r '* indicates the presence or absence of feature value FV° in item p. Any distance metric may be used to 
determine the per-user dimension squared distance between vectors feature value and feature value oty for user i. 
For example, any of the methods referred to above for calculating user similarity may be used. 

Defining 6 as -the per-user dimension squared distance between two feature values, the total distance between 
the two feature value vectors is expressed mathematically as: 



25 



&{FV* .FV a ) : 



\\Us*rs\\ 

)x( t 6°?) 

f =1 



where, the term 

30 
35 

represents adjustment for missing data. 

The combination function for the two vectors, which represents a kind of average for the two vectors, is expressed 
mathematically by the following three equations. 

1 and n a /= I 
I and 77 *> = (> 
0 and 7j a y= I 

so wherein r\** indicates whether v"* is defined. 

Another method for calculating the similarity between any two feature values is to assume the number of values 
used to compute v"* is sufficiently large. If this assumption is made, the Central Limit Theorem can be used to justify 
approximating the distribution of vectors by a Gaussian distribution. 

Since the Gaussian distribution can be effectively characterized by its mean, variance and sample size, each entry 
55 \'°x is now a triplet. 
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is the sample mean of the population. 



20 



25 is the variance of the sampling distribution, and 
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is the sample size. 

The total distance between the two feature value vectors is expressed mathematically by: 
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The feature value combination function combines the corresponding triplets from the two vectors by treating them 
is as gaussians, and therefore is represented mathematically by: 



so 
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represents the mean of the new population, 



IS 

represents the variance of the combined population, and 



represents the sample size of the combined population. 

The third method of calculating feature value similarity metrics attempts to take into account the variance of the 
sampling distribution when the sample size of the population is small. A more accurate estimator of the population 
variance is given by the term 



' " (irwr,-))-. 

35 

and represents the sample variance, which is an accurate estimator of the underlying population variance. 
Accordingly operator ti** is redefined as: 
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and the triplet is defined as: 
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Given the above, the sample variance is represented as: 
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The sample variance and the variance of the sample distribution for a finite population are related by the following 
relationship: 
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Thus, the feature value vector combination function is defined as: 
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Regardless of the feature value combination function used, the item similarity metrics generated by them are used 
to generate feature value clusters. Feature value clusters are generated from the item similarity metrics using any 
clustering algorithm known in the art. For example, the method described above with respect to grouping items could 
be used to group values within each feature. 

Feature values can be clustered both periodically and incrementally. Incremental clustering is necessary when the 
number of feature values for items is so large that rectustering of all feature values cannot be done conveniently. 
However, incremental clustering may be used for any set of items, and it is preferred to use both periodic reclustering 
and incremental reclustering. 

All feature values are periodically reclustered using any clustering method known in the art, such as eigenanalysis. 
It is preferred that this is done infrequently, because of the time that may be required to complete such a reclustering. 
In order to cluster new feature values present in items new to the domain, feature values are incrementally clustered. 
New feature values present in the new items are clustered into the already existing feature value clusters. These feature 
values may or may not be reclustered into another feature value cluster when the next complete reclustering is done 

Using the feature value clusters generated by any one of the methods described above, a method for recommend- 
ing an item, as shown in FIG. 2. uses feature clusters to aid in predicting ratings and proceeds as the method of FIG 
1, in that a plurality of user profiles is stored (step 102') and a plurality of item profiles are stored (step 104') The 
method using feature value clusters assigns a weight to each feature value cluster and a weight to each feature based 
on the users rating of the item (steps 1 20 and 1 22). 

A feature value cluster weight for each cluster is calculated for each user based on the user's ratings of items 
containing that cluster. The cluster weight is an indication of how important a particular user seems to find a particular 
feature value cluster. For example, a feature for an item in a music domain might be the identity of the producer If a 
user rated highly all items having a particular producer (or cluster of producers), then the user appears to place great 
emphasis on that particular producer (feature value) or cluster of producers (feature value cluster). 

Any method of assigning feature value cluster weight that takes into account the user's rating of the item and the 
existence of the feature value cluster for that item is sufficient, however, it is currently preferred to assign feature value 
cluster weights by summing all of the item ratings that a user has entered and dividing by the number. of feature value 
clusters. Expressed mathematically, the vector weight for cluster x of feature a for user I is: 
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otherwise 
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where y£* is a boolean operator indicating whether item p contains the feature value cluster x of feature a. 

The feature value cluster weight is used, in turn, to define a feature weight. The feature weight reflects the impor- 
tance of that feature relative to the other features for a particular feature. Any method of estimating a feature weight 
can be used: for example, feature weights may be defined as the reciprocal of the number of features defined for all 
items. It is preferred that feature weights are defined as the standard deviation of all cluster weight divided by the 
means of all cluster weights. Expressed mathematically: 
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The feature value cluster weights and the feature weights are used to calculate the similarity factor between two 
users. The similarity factor between two users may be calculated by any method that takes into account the assigned 
weights. For example, any of the methods for calculating the similarity between two users, as described above, may 
be used provided they are augmented by the feature weights and feature value weights. Thus 
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represents the similarity between users I and J. where 



40 



45 



is a boolean operator on a vector of values indicating whether feature value cluster of x for feature a of the vector is 
defined and where 



so 



otherwise 



00 



55 The representation of an item as a set of feature values allows the application of various feature-based similarity 

metrics between items. Two items may not share any identical feature values but still be considered quite similar to 
each other if they share some feature value clusters. This allows the recommendation of unrated items to a user based 
on the unrated items similarity to other items which the user has already rated highly. 
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An apparatus may be provided to recommend items to a user The apparatus, as shown in FIG. 3 has a memory 
element 1 2 for storing user and item profiles. Memory element 1 2 can be any memory element capable of storing the 
profiles such as. RAM. EPROM, or magnetic media. 

A means 14 for calculating is provided which calculates the similarity factors between users. Calculating means 
14 may be specialized hardware to do the calculation or. alternatively, calculating means 14 may be a microprocessor 
or software running on a microprocessor resident in a general-purpose computer. 

Means 16 for selecting is also provided to select neighboring users responsive to the similarity factors. Again, 
specialized hardware or a microprocessor may be provided to implement the selecting means 16. however preferred 
is to provide a software program running on a microprocessor resident in a general-purpose computer. Selecting means 
16 may be a separate microprocessor from calculating means 14 or it may be the same microprocessor. 

A means 18 for assigning a weight to each of the neighboring users is provided and can be specialized hardware, 
a separate microprocessor, the same microprocessor as calculating means 14 and selecting means 16. or a micro- 
processor resident in a general-purpose computer and running software. 

In some embodiments a receiving means is included in the apparatus (not shown m FIG. 3). Receiving means is 
any device which receives ratings for items from users. The receiving means may be a keyboard or mouse connected 
to a personal computer In some embodiments, an electronic mail system operating over a local are network or a wide 
area network forms the receiving mean9. In the preferred embodiment, a World Wide Web Page connected to the 
Internet forms the receiving means. 

Also included-in the apparatus is means 20 for recommending at least one of the items to the users based on the 
weights assigned to the users, neighboring users and the ratings given to the item by the users' neighboring users. 
Recommendation means 20 may be specialized hardware, a microprocessor, or. as above, a microprocessor running 
software and resident on a general-purpose computer. Recommendation means 20 may also comprise an output device 
such as a display, audio output, or printed output. 

In another embodiment an apparatus for recommending an item is provided that uses feature weights and feature 
value weights. This apparatus is similar to the one described above except that it also includes a means for assigning 
a feature value cluster weight 22 and a means for assigning a feature weight 24 (not shown in FIG. 3). Feature value 
cluster weight assigning means 22 and feature value weight assigning means 24 may be provided as specialized 
hardware, a separate microprocessor, the same microprocessor as the other means, or as a single microprocessor in 
a general purpose computer. 

FIG. 4 shows the Internet system on which the preferred method and apparatus may be used. The server 44 is 
an apparatus as shown in FIG. 3, and it is preferred that server 40 displays a World Wide Web Page when accessed 
by a user via Internet 42. Server 40 also accepts input over the Internet 42. Multiple users 44 may access server 40 
simultaneously. 

EXAMPLE 

The following example is one way of using the invention, which can be used to recommend items in various domains 
for many items. By way of example, a new user 44 accesses the system via the World Wide Web. The system displays 
a welcome page, which allows the user 44 to create an alias to use when accessing the system. Once the user 44 has 
entered a personal alias, the user 44 is asked to rate a number of items, in this example the items to be rated are 
recording artists in the music domain. 

After the user 44 has submitted ratings for various recording artists, the system allows the user 44 to enter ratings 
for additional artists or to request recommendations. If the user 44 desires to enter ratings for additional artists, the 
system can provide a list of artists the user 44 has not yet rated. For the example, the system can simply provide a 
random listing of artists not yet rated by the user 44. Alternatively, the user 44 can request to rate artists that are similar 
to recording artists they have already rated, and the system will provide a list of similar artists using the item similarity 
values previously calculated by the system. The user can also request to rate recording artists from a particular group, 
e.g. modem jazz, rock, or big band, and the system will provide the user 44 with a list of artists belonging to that group 
that the user 44 has not yet rated. The user 44 can also request to rate more artists that the user's 44 neighboring 
users have rated, and the system will provide the user 44 with a list of artists by selecting artists rated by the user's 
44 neighboring users. 

The user 44 can request the system to make artist recommendations at any time, and the system allows the user 
44 to tailor their request based on a number of different factors. Thus, the system can recommend artists from various 
groups that the user's 44 neighboring users have also rated highly. Similarly, the system can recommend a predeter- 
mined number of artists from a particular group that the user will enjoy, e.g. opera singers. Alternatively, the system 
may combine these approaches and recommend only opera singers that the user's neighboring users have rated highly. 

The system allows the user 44 to switch between rating items and receiving recommendations many times The 
system also provides a messaging function, so that users 44 may leave messages for other users that are not currently 
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using the system. The system provides "chat rooms." which allow users 44 to engage in conversation with other users 
44' that are currently accessing the system. These features are provided to allow users 44 to communicate with one 
another The system facilitates user communication by informing a user 44 that another user 44' shares an interest in 
a particular recording artist. Also, the system may inform a user 44 that another user 44 that shares an interest in a 
s particular recording artists is currently accessing the system, the system will not only inform the user 44. but will en- 
courage the user 44 to contact the other user 44' that shares the interest. The user 44 may leave the system by leaving 
the Web Page. 

Having described preferred embodiments of the invention, it will now become apparent to one of skill in the art 
that other embodiments incorporating the concepts may be used. It is felt: therefore, that these embodiments should 
'0 not be limited to disclosed embodiments but rather should be limited only by scope of the following claims. 

Claims 

[5 1. A method for recommending an item to one of a plurality of users, the item not yet rated by the user, the method 
comprising the steps of: 

(a) storing a user profile in a memory for each of a plurality of users, wherein the user profile includes a pJurality 
of values: each of at least some of the plurality of values representing a rating given to* one of a plurality of 
items by the user: 

(b) storing an item profile in a memory for each of the plurality of items, each of the plurality of items belonging 
to one of a plurality of groups, wherein the item profile includes a plurality of values, each of at least some of 
the plurality of values representing a rating given to the item by one of the plurality of users: 

(c) calculating, for each of the plurality of users, a plurality of similarity factors, each of the plurality of similarity 
factors representing the similarity between each user and another of the plurality of users based on item ratings 
for a particular group: 

(d) selecting, for each of the plurality of users, a plurality of neighboring users with respect to each group, the 
selection responsive to the similarity factors: 

(e) assigning a weight to each of the neighboring users: and 

(f ) recommending an item to one of the plurality of users based on the weights assigned to the user's neigh- 
boring users and the ratings given to the unrated item by the user's neighboring users. 

2. The method of claim 1 wherein step (c) further comprises: 

(c-a) retrieving the item profile for one of the plurality of items that has been rated by one of the plurality of users: 
(c-b) determining, from the item's profile, other users that have also rated the item: 
(c-c) calculating a similarity factor between the one user and each of the plurality of other users that have also 
rated the item; 

(c-d) repeating steps (c-a) through (c-c) until all items rated by the one user for the one group have been 
retrieved; and 

(c-e) repeating steps (c-a) though (c-d) until similarity factors for each user have been calculated. 

3. The method of claim 2 wherein step (c-c) further comprises calculating a similarity factor between the one user 
and each of the plurality of other users that have also rated the item, said similarity factor oabed only on ratings 

is for other items belonging to the same group. 

4. The method of any preceding claim wherein step (d) comprises selecting, for each of the plurality of users, a 
plurality of neighboring users in each group, each selected neighboring user having a similarity factor less than a 
predetermined threshold value. 

50 

5. The method of claim 4 wherein step (e) further comprises: 

subtracting, for each neighboring user, the similarity factor for that neighboring user from a predetermined 
threshold value and dividing each difference by the predetermined threshold value. 

55 6. The method of any preceding claim wherein step (f) comprises: 

predicting a rating for each item in one of the plurality of groups not yet rated by one of the plurality of users 
by taking a weighted average of the ratings given to the items in the group by the one user's neighboring users: 
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and 

recommending a predetermined number of items from the group based on the predicted ratings for those items 

7. The method of any of claims 1 to 5 wherein step (f) comprises: 
receiving an item selection from one of the plurality of users: and 

predicting a rating for the selected item by taking a weighted average of the ratings given to the selected item 
by the one user's neighboring users for the group. 

8. The method of any of claims 1 to 5 wherein step (f) comprises: 
receiving a group selection from one of the plurality of users: 

predicting a rating for items in the selected group by taking a weighted average of the ratings given to the 
items in the group by the one user's neighboring users for that group: and 

recommending a predetermined number of items in the group based on the predicted ratings for those items. 

9. The method of any preceding claim further comprising the step of: 
(g) displaying information about recommended items on a display. 

10. The method of any preceding claim wherein an item belongs to multiple groups. 

11. A method for recommending, to one of a plurality of users, other users, the method comprising the steps of: 

(a) storing a user profile in a memory for each of a plurality of users, wherein the user profile includes a plurality 
of values, each of at least some of the plurality of values representing a rating given to one of a plurality of 
items by the user: 

(b) storing an item profile in a memory for each of the plurality of items, each of the plurality of items belonging 
to one of a plurality of groups, wherein the item profile includes a plurality of values, each of at least some of 
the plurality of values representing a rating given to the item by one of the plurality of users: 

(c) calculating, for each of the plurality of users, a plurality of similarity factors, each of the plurality of similarity 
factors representing the similarity between each user and another one of the plurality of users based on the 
item ratings for a particular group; 

(d) recommending at least one of the neighboring users to one of the plurality of users based on the similarity 
factors. 

method of claim 11 wherein step (d) further comprises recommending at least one of the neighboring users 
ie of the plurality of users based on the similarity factors and the number of items rated by both the one user 
the at least one neighboring user. 

■w 13. A method for predicting a rating for an item, the item having at least one feature defining a characteristic of the 
item and having a plurality of possible values that may be grouped into clusters of feature values, the method 
comprising the steps of: 

(a) storing a user profile in a memory for each of a plurality of users, wherein the user profile includes a plurality 
45 of values, each of at least some of the plurality of values representing a rating given to one of a plurality of 

items by the user 

(b) storing an item profile in a memory for each of the plurality of items, wherein the item profile includes a 
plurality of values, each of at least some of the plurality of values representing a rating given to the item by 
one of the plurality of users; 

so (c) assigning, for each user, a weight to each value cluster within each feature; 

(d) assigning, for each user, a weight to each feature; 

(e) calculating, for each of the plurality of users, a plurality of similarity factors, each of the plurality of similarity 
factors based on the feature weights, the cluster weights, and the ratings given to items by the respective users. 

(f ) selecting, for each of the plurality of users, a plurality of neighboring users responsive to the similarity factors: 
55 (g) assigning a weight to each of the neighboring users: and 

(h) recommending an item to one of the plurality of users based on the weights assigned to the user's neigh- 
boring users and the ratings given to the unrated item by the user's neighboring users. 
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14. The method of claim 1 3 wherein step (c) further comprises. 

assigning, for each user, a weight to each vaiue cluster within each feature based on the rating given to the 
item by the user and the number of feature vaiue clusters present. 

5 15. The method of claim 1 3 or 14 wherein step (d) further comprises: 

assigning, for each user, a weight to each feature based on the number of features defined for the item. 

16. The method of claim 1 3 or 14 wherein step (d) further comprises: 

assigning, for each user, a weight to each feature based on the weights assigned to each feature value cluster. 

w 

17. The method of claim 16. wherein the feature weight is assigned by dividing the standard deviation of the cluster 
weights by the mean of the cluster weights. 

18. The method of any of claims 1 3 to 17, wherein step (c) further comprises the steps of: 

is 

(c-a) calculating, for each feature value, a similarity factor to all other feature values in a feature: and 
(c-b) grouping the feature values* into clusters based on the similarity factors. 

19. A method for~recommending an item to one of a plurality of users, the item having at least one feature defining a 
20 characteristic of the item and having a plurality of possible values that may be grouped into clusters of feature 

values, the method comprising the steps of: 

(a) storing a user profile in a memory for each of a plurality of users, wherein the user profile includes a plurality 
of values, each of at least some of the plurality of values representing a rating given to one of a plurality of 

25 items by the user: 

(b) storing an item profile in a memory for each of the plurality of items, wherein the item profile includes a 
plurality of values, each of at least some of the plurality of values representing a rating given to the item by 
one of the plurality of users: 

(c) assigning, for at least one user, a weight to each value cluster within each feature: 
30 (d) assigning, for the at least one user, a weight to each feature: 

(e) calculating, for each of the plurality of items, a plurality of similarity factors, each of the plurality of similarity 
factors based on the feature weights and the cluster weights; 

(f) selecting an item for which a favourable rating has been received from the at least one user: 

(g) selecting a plurality of items responsive to the selected item and the similarity factors: 
35 (h) recommending at least one of the selected items to the at least one user. 



20. An article of manufacture having program means embodied therein, the program means for predicting a rating for 
an item, the item having at least one feature defining a characteristic of the item and having a plurality of possible 
values that may be grouped into clusters of feature values, the article of manufacture comprising: 



40 



computer-readable program means for storing a user profile in a memory for each of a plurality of users, 
wherein the user profile includes a plurality of values, each of at least some of the plurality of values repre- 
senting a rating given to one of a plurality of items by the user: 

computer-readable program means for storing an item profile in a memory for each of the plurality of items, 
J 5 wherein the item profile includes a plurality of values, each of at least some of the plurality of values repre- 

senting a rating given to the item by one of the plurality of users: 

computer-readable program means for assigning, for each user, a weight to each value cluster within each 
feature: 

computer-readable program means for assigning, for each user, a weight to each feature: 
so computer- readable program means for calculating, for each of the plurality of users, a plurality of similarity 

factors, each of the plurality of similarity factors based on the feature weights, the cluster weights, and the 
ratings given to items by the respective users: 

computer-readable program means for selecting, for each of the plurality of users, a plurality of neighboring 
users responsive to the similarity factors; 
55 computer-readable program means for assigning a weight to each of the neighboring users: and 

computer-readable program means for recommending an item to one of the plurality of users based on the 
weights assigned to the user's neighboring users and the ratings given to the unrated item by the user's neigh- 
boring users. 



18 



8NS0OCl0:<6P 075M71A1> 



EP0 751 471 A1 



21. An apparatus-for recommending an item, the item having at least one feature defining a characteristic of the item 
and having a plurality of possible values that may be grouped into clusters of feature values, comprising: 

a memory element for storing user profiles, wherein each user profile includes a plurality of values, each of at 
5 least some of the plurality of values representing a rating given to one of a plurality of items by the user: 

a memory element for storing item profiles, wherein each item profile includes a plurality of values, each of at 

least some of the plurality of values representing a rating given to the item by one of the plurality of users: 

means for assigning, for each user, a weight to each value cluster within each feature: 

means for assigning, for each user, a weight to each feature: 
10 means for calculating, for each of the plurality of users, a plurality of similarity factors, each of the plurality of 

similarity factors based on the feature weights, the cluster weights, and the ratings given to items by the 

respective users: 

means for selecting, for each of the plurality of users, a plurality of neighboring users responsive to the similarity 
factors: 

15 means for assigning a weight to each of the neighboring users: and 

means for recommending an item to one of the plurality of users based on the weights assigned to the user's 
neighboring users and the ratings given to the unrated item by the user's neighboring users. 

20 



25 



30 



35 



40 



45 



50 



BNSOOCI0:<£P 075t471At> 



19 



EP 0 751 471 A1 



STORE USER 
PROFILES 



I 



STORE ITEM 
PROFILES 



CALCULATE 

SIMILARITY 

FACTORS 



SELECT 
NEIGHBORING 
USERS 



FIG. 1 



102 



104' 



i — 106 




BNSOOCID:<EP 075U71A1> 



20 



EP0 751 471 A1 



STORE USER 
PROFILES 



STORE ITEM 
PROFILES 



ASSIGN FEATURE 
WEIGHT . 



ASSIGN FEATURE 
VALUE CLUSTER 
WEIGHT 



CALCULATE 

SMLARITY 

FACTORS 



102 



104' 



120 



I ^—122 



106 



SELECT 
NEIGHBORING 
USERS 



i 110 

ASSIGN WEIGHT 
TO NEIGHBORING 
USERS 

I 112 

RECOMMEND ITEM 



FIG. 2 



BNSOOCIO:<EP 075t47lA1> 



21 



EP0 751 471 A1 




BNSOOOD: ^EP 075U71A1> 



22 



EP 0 751 471 A1 




6NS0OCI0:<EP 0751471A1> 



23 



EP0 751 471 A1 



European Patent 
Office 



EUROPEAN SEARCH REPORT 



ApplicillOQ >urab«r 

EP 96 30 4536 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Catefory 



C it ltd* a w4 aacament with tndtcatnn. where aaarafriate, 

of relevant passages 



Relevant 

tO CUlfD 



CLASSIFICATION OF THE 
VKPUCATION (InuCLa) 



TRANSCENDING BOUNDARIES, CSCW v 94. 
PROCEEDINGS OF THE CONFERENCE ON COMPUTER 
SUPPORTED COOPERATIVE WORK, WORKSHOPS OF 
THE CONFERENCE ON COMPUTER SUPPORTED 
COLLABORATIVE WORK, CHAPEL HILL, NC, USA, 
22-23 OCT. 1994, ISBN 0-8979L-689-1 , 1994, 
NEW YORK, ,NY, USA, ACM, USA, 
pages 175-186, XPO0O6O1284 
RESNICK P ET AL: "GroupLens: an open 
architecture for collaborative filtering 
of netnews" 

* page 177, column 1, line 48 - page 183, 
column 2, line 24 * 

COMMUNICATIONS OF THE ACM, DEC. 1992, USA, 

vol. 35, no. 12, ISSN 0001-0782, 

pages 61-70, XP000334368 

GOLDBERG 0 ET AL: "Using collaborative 

filtering to weave an information 

tapestry" 

* page 63, column 1, line 49 - page 64, 
column 3, line 37 * 



1,11,13 
19-21 



G06F17/6O 



1,11.13, 
19-21 



TECHNICAL FIELDS 
SEARCHED Oat. da) 



G06F 



Urn | 



t stare* reaert has beta aYaw* ua for at ctatoai 



PlnWuM 

THE HAGUE 



26 September 1996 



Suendermann , R 



CATEGORY OF CITED DOCUMENTS 

3 X : aarttotfafty rtie*ia« if takaa aloaa 
5 Y : ■artiarfarly relmat if cofabtaei witfc aaacaer 
2 docuwi of ta* sum category 

A :. tecboolofical tacit/Ma* 
0 : nea-wnftea iwdotxut 
P : laterawauti totnaeal 



T : tbeary or omdfU aaafrtyiag ta* iaivatioa 
E : earlier pi(«at socman*, but puatiihe* oa, or 

rffer the filiag Uto 
U : locaiaaU ate* ta tb* ttpiicatioa 
L : 4acwa«at afat for otlur re a j— a 

A : raenaar of A* tame aateat fuaily, eorrtsaoatiag 



24 



BNSOOCIOr<£P 075147iA1> 



